Achieving a Target Gait Behavior in a Legged Robot

ABSTRACT

A legged robot may seek to operate according to a target gait. The legged robot may include leg members and leg joints. Possibly based on the target gait and state of the legged robot, an ordered list of gait controllers may be obtained. The gait controllers in the ordered list may define respective gaits of the legged robot, and may include respective validity checks and output parameters for the respective gaits. The ordered list may begin with a target gait controller that defines the target gait. The ordered list may be traversed in order from the target gait controller until a validity check associated with a particular gait controller passes. The legged robot may be instructed to actuate the leg members and/or leg joints according to output parameters of the particular gait controller.

CROSS REFERENCE TO RELATED APPLICATIONS

This U.S. patent application is a continuation of, and claims priorityunder 35 U.S.C. § 120 from, U.S. patent application Ser. No. 16/166,673,filed on Oct. 22, 2018, which is a continuation of U.S. patentapplication Ser. No. 16/006,943, filed on Jun. 13, 2018, which is acontinuation of U.S. patent application Ser. No. 15/194,493, file onJun. 27, 2016, which claims priority under 35 U.S.C. § 119(e) to U.S.Provisional Application 62/253,807, filed on Nov. 11, 2015. Thedisclosures of these prior applications are considered part of thedisclosure of this application and are hereby incorporated by referencein their entireties.

BACKGROUND

A gait of a legged robot is typically viewed as a cyclic pattern of legmovements that produces locomotion through a sequence of foot contactswith a surface. The legs provide support for the body of the leggedrobot while the forces resulting from surface contact propel the leggedrobot. Gaits can differ in a variety of ways, and different gaitsproduce different styles of locomotion. Selection of an appropriate gaitwhen the legged robot is in a particular state can be challenging, assome gaits might result in the robot becoming unstable or exhibitingundesirable movement.

SUMMARY

The implementations herein involve selection of a gait for a leggedrobot. In some cases, the gait may be selected based on a state of thelegged robot and/or one or more input commands obtained by the leggedrobot. Each gait may be represented as a gait controller that includes amapping from the state of the legged robot and/or the input command(s)to output parameters that achieve the gait. Each gait controller mayinclude a validity check that tests whether the instantaneous state ofthe legged robot allows the associated gait to be achieved.

In particular, the gait controllers may be arranged in an ordered listsuch that a target gait controller for a target gait is at the beginningof the ordered list, and other gait controllers are placed in theordered list based on how the legged robot can transition from theirrespective gaits to the target gait. In some implementations, gaitcontrollers representing gaits that are more similar to the target gaitare placed closer to the beginning of the ordered list than thoserepresenting gaits that are less similar to the target gait.

The ordered list may be traversed in order from its beginning, and thegait controllers therein may be examined. For each gait controllerexamined, the associated validity check may be tested. A validity checkassociated with a particular gait controller may determine whether thegait controller is permitted to operate based on the state of the robotand/or a sensed environment of the robot. When a validity check of aparticular gait controller passes, the legged robot may be operated fora period of time according to the associated gait. The ordered list maybe traversed again from the beginning, resulting in the selection of thesame or a different gait controller. The process may repeat severaldozen or hundred times per second to provide fine-grained control overthe legged robot's locomotion.

Accordingly, a first example implementation may involve determining thata legged robot is to operate according to a target gait. The leggedrobot may include leg members and leg joints. Possibly based on thetarget gait and state of the legged robot, an ordered list of gaitcontrollers may be obtained. The gait controllers in the ordered listmay define respective gaits of the legged robot, and may includerespective validity checks and output parameters for the respectivegaits. The ordered list may begin with a target gait controller thatdefines the target gait. The ordered list may be traversed in order fromthe target gait controller until a validity check associated with aparticular gait controller passes. The legged robot may be instructed toactuate the leg members and/or leg joints according to output parametersof the particular gait controller.

In a second example implementation, an article of manufacture mayinclude a non-transitory computer-readable medium, having stored thereonprogram instructions that, upon execution by a computing device, causethe computing device to perform operations in accordance with the firstexample implementation.

In a third example implementation, a legged robot may include legmembers, leg joints, at least one processor, and data storage. Programinstructions may be stored in the data storage, and upon execution bythe at least one processor, the program instructions may cause thelegged robot to perform operations in accordance with the first exampleimplementation.

In a fourth example implementation, a system may include various meansfor carrying out each of the operations of the first exampleimplementation.

These as well as other implementations, aspects, features, advantages,and alternatives will become apparent to those of ordinary skill in theart by reading the following detailed description, with reference whereappropriate to the accompanying drawings. Further, it should beunderstood that this summary and other descriptions and figures providedherein are intended to illustrate implementations by way of example onlyand, as such, that numerous variations are possible. For instance,structural elements and process steps can be rearranged, combined,distributed, eliminated, or otherwise changed, while remaining withinthe scope of the implementations as claimed.

DESCRIPTION OF DRAWINGS

FIG. 1 depicts robotic system, according to example implementations.

FIG. 2 depicts a quadruped robot, according to example implementations.

FIG. 3 depicts a biped robot, according to example implementations.

FIG. 4 depicts a sequence of footfall patterns for a walk gait of aquadruped robot, according to example implementations.

FIG. 5A depicts a sequence of footfall patterns for a trot gait of aquadruped robot, according to example implementations.

FIG. 5B depicts another sequence of footfall patterns for a trot gait ofa quadruped robot, according to example implementations.

FIG. 6A depicts a list of gait controllers, according to exampleimplementations.

FIG. 6B depicts a hierarchical view of the gait controllers of FIG. 6A,according to example implementations.

FIG. 7A depicts another list of gait controllers, according to exampleimplementations.

FIG. 7B depicts a hierarchical view of the gait controllers of FIG. 7A,according to example implementations.

FIG. 8 is a flow chart, according to example implementations.

FIG. 9 depicts a sequence of footfall patterns to avoid an invalidstep-out action, according to example implementations.

FIG. 10 is another flow chart, according to example implementations.

DETAILED DESCRIPTION

Example methods, devices, and systems are described herein. It should beunderstood that the words “example” and “exemplary” are used herein tomean “serving as an example, instance, or illustration.” Anyimplementation, aspect, or feature described herein as being an“example” or “exemplary” is not necessarily to be construed as preferredor advantageous over other implementations, aspects, or features.Alternative implementations, aspects, or features can be utilized, andother changes can be made, without departing from the scope of thesubject matter presented herein.

Thus, the example implementations described herein are not meant to belimiting. Aspects of the present disclosure, as generally describedherein, and illustrated in the figures, can be arranged, substituted,combined, separated, and designed in a wide variety of differentconfigurations, all of which are contemplated herein.

Further, unless context suggests otherwise, the features illustrated ineach of the figures may be used in combination with one another. Thus,the figures should be generally viewed as component aspects of one ormore overall implementations, with the understanding that not allillustrated features are necessary for each implementation.

Example Robotic Devices

FIG. 1 illustrates an example configuration of a robotic system that maybe used in connection with the implementations described herein. Therobotic system 100 may be configured to operate autonomously,semi-autonomously, and/or using directions provided by user(s). Therobotic system 100 may be implemented in various forms, such as a bipedrobot, quadruped robot, or some other arrangement. Furthermore, therobotic system 100 may also be referred to as a robot, robotic device,or mobile robot, among other designations.

As shown in FIG. 1, the robotic system 100 may include processor(s) 102,data storage 104, and controller(s) 108, which together may be part of acontrol system 118. The robotic system 100 may also include sensor(s)112, power source(s) 114, mechanical components 110, and electricalcomponents 116. Nonetheless, the robotic system 100 is shown forillustrative purposes, and may include more or fewer components. Thevarious components of robotic system 100 may be connected in any manner,including wired or wireless connections. Further, in some examples,components of the robotic system 100 may be distributed among multiplephysical entities rather than a single physical entity. Other exampleillustrations of robotic system 100 may exist as well.

Processor(s) 102 may operate as one or more general-purpose hardwareprocessors or special purpose hardware processors (e.g., digital signalprocessors, application specific integrated circuits, etc.). Theprocessor(s) 102 may be configured to execute computer-readable programinstructions 106, and manipulate data 107, both of which are stored inthe data storage 104. The processor(s) 102 may also directly orindirectly interact with other components of the robotic system 100,such as sensor(s) 112, power source(s) 114, mechanical components 110,and/or electrical components 116.

The data storage 104 may be one or more types of hardware memory. Forexample, the data storage 104 may include or take the form of one ormore computer-readable storage media that can be read or accessed byprocessor(s) 102. The one or more computer-readable storage media caninclude volatile and/or non-volatile storage components, such asoptical, magnetic, organic, or another type of memory or storage, whichcan be integrated in whole or in part with processor(s) 102. In someimplementations, the data storage 104 can be a single physical device.In other implementations, the data storage 104 can be implemented usingtwo or more physical devices, which may communicate with one another viawired or wireless communication. As noted previously, the data storage104 may include the computer-readable program instructions 106 and thedata 107. The data 107 may be any type of data, such as configurationdata, sensor data, and/or diagnostic data, among other possibilities.

The controller 108 may include one or more electrical circuits, units ofdigital logic, computer chips, and/or microprocessors that areconfigured to (perhaps among other tasks), interface between anycombination of the mechanical components 110, the sensor(s) 112, thepower source(s) 114, the electrical components 116, the control system118, and/or a user of the robotic system 100. In some implementations,the controller 108 may be a purpose-built embedded device for performingspecific operations with one or more subsystems of the robotic device100.

The control system 118 may monitor and physically change the operatingconditions of the robotic system 100. In doing so, the control system118 may serve as a link between portions of the robotic system 100, suchas between mechanical components 110 and/or electrical components 116.In some instances, the control system 118 may serve as an interfacebetween the robotic system 100 and another computing device. Further,the control system 118 may serve as an interface between the roboticsystem 100 and a user. The instance, the control system 118 may includevarious components for communicating with the robotic system 100,including a joystick, buttons, and/or ports, etc. The example interfacesand communications noted above may be implemented via a wired orwireless connection, or both. The control system 118 may perform otheroperations for the robotic system 100 as well.

During operation, the control system 118 may communicate with othersystems of the robotic system 100 via wired or wireless connections, andmay further be configured to communicate with one or more users of therobot. As one possible illustration, the control system 118 may receivean input (e.g., from a user or from another robot) indicating aninstruction to perform a particular gait in a particular direction, andat a particular speed. A gait is a pattern of movement of the limbs ofan animal, robot, or other mechanical structure.

Based on this input, the control system 118 may perform operations tocause the robotic device 100 to move according to the requested gait. Asanother illustration, a control system may receive an input indicatingan instruction to move to a particular geographical location. Inresponse, the control system 118 (perhaps with the assistance of othercomponents or systems) may determine a direction, speed, and/or gaitbased on the environment through which the robotic system 100 is movingen route to the geographical location.

Operations of the control system 118 may be carried out by theprocessor(s) 102. Alternatively, these operations may be carried out bythe controller 108, or a combination of the processor(s) 102 and thecontroller 108. In some implementations, the control system 118 maypartially or wholly reside on a device other than the robotic system100, and therefore may at least in part control the robotic system 100remotely.

Mechanical components 110 represent hardware of the robotic system 100that may enable the robotic system 100 to perform physical operations.As a few examples, the robotic system 100 may include physical memberssuch as leg(s), arm(s), and/or wheel(s). The physical members or otherparts of robotic system 100 may further include actuators arranged tomove the physical members in relation to one another. The robotic system100 may also include one or more structured bodies for housing thecontrol system 118 and/or other components, and may further includeother types of mechanical components. The particular mechanicalcomponents 110 used in a given robot may vary based on the design of therobot, and may also be based on the operations and/or tasks the robotmay be configured to perform.

In some examples, the mechanical components 110 may include one or moreremovable components. The robotic system 100 may be configured to addand/or remove such removable components, which may involve assistancefrom a user and/or another robot. For example, the robotic system 100may be configured with removable arms, hands, feet, and/or legs, so thatthese appendages can be replaced or changed as needed or desired. Insome implementations, the robotic system 100 may include one or moreremovable and/or replaceable battery units or sensors. Other types ofremovable components may be included within some implementations.

The robotic system 100 may include sensor(s) 112 arranged to senseaspects of the robotic system 100. The sensor(s) 112 may include one ormore force sensors, torque sensors, velocity sensors, accelerationsensors, position sensors, proximity sensors, motion sensors, locationsensors, load sensors, temperature sensors, touch sensors, depthsensors, ultrasonic range sensors, infrared sensors, object sensors,and/or cameras, among other possibilities. Within some examples, therobotic system 100 may be configured to receive sensor data from sensorsthat are physically separated from the robot (e.g., sensors that arepositioned on other robots or located within the environment in whichthe robot is operating).

The sensor(s) 112 may provide sensor data to the processor(s) 102(perhaps by way of data 107) to allow for interaction of the roboticsystem 100 with its environment, as well as monitoring of the operationof the robotic system 100. The sensor data may be used in evaluation ofvarious factors for activation, movement, and deactivation of mechanicalcomponents 110 and electrical components 116 by control system 118. Forexample, the sensor(s) 112 may capture data corresponding to the terrainof the environment or location of nearby objects, which may assist withenvironment recognition and navigation. In an example configuration,sensor(s) 112 may include RADAR (e.g., for long-range object detection,distance determination, and/or speed determination), LIDAR (e.g., forshort-range object detection, distance determination, and/or speeddetermination), SONAR (e.g., for underwater object detection, distancedetermination, and/or speed determination), VICON® (e.g., for motioncapture), one or more cameras (e.g., stereoscopic cameras for 3Dvision), a global positioning system (GPS) transceiver, and/or othersensors for capturing information of the environment in which therobotic system 100 is operating. The sensor(s) 112 may monitor theenvironment in real time, and detect obstacles, elements of the terrain,weather conditions, temperature, and/or other aspects of theenvironment.

Further, the robotic system 100 may include sensor(s) 112 configured toreceive information indicative of the state of the robotic system 100,including sensor(s) 112 that may monitor the state of the variouscomponents of the robotic system 100. The sensor(s) 112 may measureactivity of systems of the robotic system 100 and receive informationbased on the operation of the various features of the robotic system100, such the operation of extendable legs, arms, or other mechanicaland/or electrical features of the robotic system 100. The data providedby the sensor(s) 112 may enable the control system 118 to determineerrors in operation as well as monitor overall operation of componentsof the robotic system 100.

As an example, the robotic system 100 may use force sensors to measureload on various components of the robotic system 100. In someimplementations, the robotic system 100 may include one or more forcesensors on an arm or a leg to measure the load on the actuators thatmove one or more members of the arm or leg. As another example, therobotic system 100 may use one or more position sensors to sense theposition of the actuators of the robotic system. For instance, suchposition sensors may sense states of extension, retraction, or rotationof the actuators on arms or legs.

As another example, the sensor(s) 112 may include one or more velocityand/or acceleration sensors. For instance, the sensor(s) 112 may includean inertial measurement unit (IMU). The IMU may sense velocity andacceleration in the world frame, with respect to the gravity vector. Thevelocity and acceleration sensed by the IMU may then be translated tothat of the robotic system 100 based on the location of the IMU in therobotic system 100 and the kinematics of the robotic system 100.

The robotic system 100 may include other types of sensors not explicateddiscussed herein. Additionally or alternatively, the robotic system mayuse particular sensors for purposes not enumerated herein.

The robotic system 100 may also include one or more power source(s) 114configured to supply power to various components of the robotic system100. Among other possible power systems, the robotic system 100 mayinclude a hydraulic system, electrical system, batteries, and/or othertypes of power systems. As an example illustration, the robotic system100 may include one or more batteries configured to provide charge tocomponents of the robotic system 100. Some of the mechanical components110 and/or electrical components 116 may each connect to a differentpower source, may be powered by the same power source, or be powered bymultiple power sources.

Any type of power source may be used to power the robotic system 100,such as electrical power or a gasoline engine. Additionally oralternatively, the robotic system 100 may include a hydraulic systemconfigured to provide power to the mechanical components 110 using fluidpower. Components of the robotic system 100 may operate based onhydraulic fluid being transmitted throughout the hydraulic system tovarious hydraulic motors and hydraulic cylinders, for example. Thehydraulic system may transfer hydraulic power by way of pressurizedhydraulic fluid through tubes, flexible hoses, or other links betweencomponents of the robotic system 100. The power source(s) 114 may chargeusing various types of charging, such as wired connections to an outsidepower source, wireless charging, combustion, or other examples.

The electrical components 116 may include various mechanisms capable ofprocessing, transferring, and/or providing electrical charge or electricsignals. Among possible examples, the electrical components 116 mayinclude electrical wires, circuitry, and/or wireless communicationtransmitters and receivers to enable operations of the robotic system100. The electrical components 116 may interwork with the mechanicalcomponents 110 to enable the robotic system 100 to perform variousoperations. The electrical components 116 may be configured to providepower from the power source(s) 114 to the various mechanical components110, for example. Further, the robotic system 100 may include electricmotors. Other examples of electrical components 116 may exist as well.

Although not shown in FIG. 1, the robotic system 100 may include a body,which may connect to or house appendages and components of the roboticsystem. As such, the structure of the body may vary within examples andmay further depend on particular operations that a given robot may havebeen designed to perform. For example, a robot developed to carry heavyloads may have a wide body that enables placement of the load.Similarly, a robot designed to reach high speeds may have a narrow,small body that does not have substantial weight. Further, the bodyand/or the other components may be developed using various types ofmaterials, such as metals or plastics. Within other examples, a robotmay have a body with a different structure or made of various types ofmaterials.

The body and/or the other components may include or carry the sensor(s)112. These sensors may be positioned in various locations on the roboticdevice 100, such as on the body and/or on one or more of the appendages,among other examples.

On its body, the robotic device 100 may carry a load, such as a type ofcargo that is to be transported. The load may also represent externalbatteries or other types of power sources (e.g., solar panels) that therobotic device 100 may utilize. Carrying the load represents one exampleuse for which the robotic device 100 may be configured, but the roboticdevice 100 may be configured to perform other operations as well.

As noted above, the robotic system 100 may include various types oflegs, arms, wheels, and so on. In general, the robotic system 100 may beconfigured with zero or more legs. An implementation of the roboticsystem with zero legs may include wheels, treads, or some other form oflocomotion. An implementation of the robotic system with two legs may bereferred to as a biped, and an implementation with four legs may bereferred as a quadruped. Implementations with six or eight legs are alsopossible. For purposes of illustration, biped and quadrupedimplementations of the robotic system 100 are described below.

FIG. 2 illustrates a quadruped robot 200, according to an exampleimplementation. Among other possible features, the robot 200 may beconfigured to perform some of the operations described herein. The robot200 includes a control system, and legs 204A, 204B, 204C, 204D connectedto a body 208. Each leg may include a respective foot 206A, 206B, 206C,206D that may contact a surface (e.g., a ground surface). Further, therobot 200 is illustrated with sensor(s) 210, and may be capable ofcarrying a load on the body 208. Within other examples, the robot 200may include more or fewer components, and thus may include componentsnot shown in FIG. 2.

The robot 200 may be a physical representation of the robotic system 100shown in FIG. 1, or may be based on other configurations. Thus, therobot 200 may include one or more of mechanical components 110,sensor(s) 112, power source(s) 114, electrical components 116, and/orcontrol system 118, among other possible components or systems.

The configuration, position, and/or structure of the legs 204A-204D mayvary in example implementations. The legs 204A-204D enable the robot 200to move relative to its environment, and may be configured to operate inmultiple degrees of freedom to enable different techniques of travel. Inparticular, the legs 204A-204D may enable the robot 200 to travel atvarious speeds according to the mechanics set forth within differentgaits. The robot 200 may use one or more gaits to travel within anenvironment, which may involve selecting a gait based on speed, terrain,the need to maneuver, and/or energy efficiency.

Further, different types of robots may use different gaits due tovariations in design. Although some gaits may have specific names (e.g.,walk, trot, run, bound, gallop, etc.), the distinctions between gaitsmay overlap. The gaits may be classified based on footfall patterns—thelocations on a surface for the placement the feet 206A-206D. Similarly,gaits may also be classified based on ambulatory mechanics.

The body 208 of the robot 200 connects to the legs 204A-204D and mayhouse various components of the robot 200. For example, the body 208 mayinclude or carry sensor(s) 210. These sensors may be any of the sensorsdiscussed in the context of sensor(s) 112, such as a camera, LIDAR, oran infrared sensor. Further, the locations of sensor(s) 210 are notlimited to those illustrated in FIG. 2. Thus, sensor(s) 210 may bepositioned in various locations on the robot 200, such as on the body208 and/or on one or more of the legs 204A-204D, among other examples.

FIG. 3 illustrates a biped robot 300 according to another exampleimplementation. Similar to robot 200, the robot 300 may correspond tothe robotic system 100 shown in FIG. 1, and may be configured to performsome of the implementations described herein. Thus, like the robot 200,the robot 300 may include one or more of mechanical components 110,sensor(s) 112, power source(s) 114, electrical components 116, and/orcontrol system 118.

For example, the robot 300 may include legs 304 and 306 connected to abody 308. Each leg may consist of one or more members connected byjoints and configured to operate with various degrees of freedom withrespect to one another. Each leg may also include a respective foot 310and 312, which may contact a surface (e.g., the ground surface). Likethe robot 200, the legs 304 and 306 may enable the robot 300 to travelat various speeds according to the mechanics set forth within gaits. Therobot 300, however, may utilize different gaits from that of the robot200, due at least in part to the differences between biped and quadrupedcapabilities.

The robot 300 may also include arms 318 and 320. These arms mayfacilitate object manipulation, load carrying, and/or balancing for therobot 300. Like legs 304 and 306, each arm may consist of one or moremembers connected by joints and configured to operate with variousdegrees of freedom with respect to one another. Each arm may alsoinclude a respective hand 322 and 324. The robot 300 may use hands 322and 324 for gripping, turning, pulling, and/or pushing objects. Thehands 322 and 324 may include various types of appendages orattachments, such as fingers, grippers, welding tools, cutting tools,and so on.

The robot 300 may also include sensor(s) 314, corresponding to sensor(s)112, and configured to provide sensor data to its control system. Insome cases, the locations of these sensors may be chosen in order tosuggest an anthropomorphic structure of the robot 300. Thus, asillustrated in FIG. 3, the robot 300 may contain vision sensors (e.g.,cameras, infrared sensors, object sensors, range sensors, etc.) withinits head 316.

Example Gaits of Legged Robots

This section describes example gaits of legged robots. Althoughquadruped gaits are described for purpose of example, theimplementations herein can support gaits of robots with varying numbersof legs, including bipeds, tripods, hexapods, etc. Gaits can differ in avariety of ways, and different gaits may produce different styles oflocomotion.

As noted above, a gait of a robot may encompass a cyclic pattern of legmovements that produce locomotion through a sequence of foot contactswith a surface (e.g., a ground surface). Additionally, acyclic gaitsdefine transitions of the robot's locomotion between two gaits, andrecovery gaits define touchdown timings and positions for the feet thatcause the legged robot to recover from deviations from a cyclic oracyclic gait.

Quadruped robots may support a number of gaits including, but notlimited to, standing, walking, trotting, pacing, pronking, cantering,galloping, and bounding. Each of these gaits involves a differentpattern of foot placements on a surface and timings thereof. In order toachieve a particular gait, the robot may be instructed to actuate itsleg members and/or leg joints in accordance with the particular gait.

For purposes of simplicity, three example cyclic quadruped gaits aredescribed in detail below: standing, walking, and trotting. Nonetheless,quadruped robots may support other gaits, and may also support multiplevariations of gaits. For instance, a robot may support variouscombinations of velocities (e.g., 1.5 miles per hour (MPH), 2.0 MPH, 2.5MPH, 3.0 MPH, 3.5 MPH, etc.) and directions (e.g., forward, sidestepleft, sidestep right, backward, etc.) for a walking gait. Despite theirsimilarities, the walking gaits for each velocity may be considered tobe different gaits. The velocities discussed herein may becenter-of-mass (COM) velocities of a robot measured by, for instance, anIMU. These velocities may be a combination of x-direction andy-direction velocities, such as a speed and angle representation of avelocity vector. But other types of velocities (and/or velocity sensors)may be used.

A stand gait may be considered to be a “gait” of a quadruped, eventhough the robot's velocity is expected to be at or near zero whenstanding. Further, a standing quadruped has all four of its feet incontact with a surface. In some situations, a standing quadruped mayexhibit some nominal velocity. For example, the quadruped may need toexert force to correct its balance, and/or move its center of mass (COM)in one direction or another to maintain a particular stance. Thus, aquadruped may be considered to be standing even if its velocity is lessthan a particular threshold, such as 0.1 MPH.

A walk may involve the quadruped moving at a velocity of approximately0.5 to 5.5 MPH, though slower and/or faster walks may be possible. Anexample leg movement sequence for a walking quadruped is moving the leftrear leg, then the left front leg, then the right rear leg, and then theright front leg in a four-beat pattern. The quadruped may alternatebetween having two and three of its feet in contact with a surface atany given time.

An example sequence of footfall patterns for a walking quadruped isshown in FIG. 4. In each pattern 400, 402, 404, 406, 408, 410, 412, 414,and 416, a foot of the quadruped that is in contact with the surface isrepresented with a solid black circle. A foot that is not in contactwith the surface (e.g., in a swing phase) is represented as a whitecircle with a black outline. Further, the abbreviations LF, RF, LR andRR represent the quadruped's left front foot, right front foot, leftrear foot, and right rear foot, respectively. Additionally, thequadruped is assumed to be moving to the right in each pattern of FIG.4.

Starting at pattern 400, the quadruped has its right front, left rear,and right rear feet on the surface, while its left front foot isswinging. In pattern 402, the left front foot continues to swing whilethe right rear foot is lifted off the surface and begins to swing. Inpattern 404, the left front foot touches down while the right rear footcontinues its swing. In pattern 406, the right front foot lifts offwhile the right rear foot again continues its swing. In pattern 408, theright rear foot touches down while the right front foot continues itsswing. In pattern 410, the left rear foot lifts off while the rightfront foot continues its swing. In pattern 412, the right front foottouches down while the left rear foot continues its swing. In pattern414, the left front foot lifts off while the left rear foot continuesits swing. In pattern 416, the left rear foot touches down while theleft front foot continues its swing.

Notably, pattern 416 may be identical or similar to pattern 400. Thus,the sequence of patterns 400, 402, 404, 406, 408, 410, 412, 414, and 416may repeat as the robot walks. Regardless, the number of feet in contactwith the surface at any one time is either 2 or 3.

A trot may involve the quadruped moving at a velocity of approximately1.0 MPH to 10 MPH, though slower and/or faster trots may be possible.One possible characteristic of a trot is that diagonal pairs of feet aremoved in unison according to a two beat pattern.

Example sequences of footfall patterns for a trotting quadruped areshown in FIGS. 5A and 5B. FIG. 5A shows a trotting footfall patternsequence in which all four feet can be on the surface simultaneously,and FIG. 5B shows a trotting footfall pattern sequence in which all fourfeet can be off the surface simultaneously. For sake of convenience, thetrotting footfall pattern sequence of FIG. 5A may be referred to as a“slow trot,” while the trotting footfall pattern sequence of FIG. 5B maybe referred to as a “fast trot.”

Starting at pattern 500 of FIG. 5A, the quadruped has all four of itsfeet on the surface. In pattern 502, the right front and left rear feetare lifted off the surface and begin to swing. In pattern 504, all fourfeet are again on the surface, but in an arrangement that is the mirrorimage of pattern 500. In pattern 506, the left front and right rear feetare lifted off the surface and being to swing. In pattern 508, all fourfeet are once more on the surface.

Notably, pattern 508 may be identical or similar to pattern 500. Thus,the sequence of patterns 500, 502, 504, 506, and 508 may repeat as therobot walks. Regardless, the number of feet in contact with the surfaceat any one time is either 2 or 4.

Starting at pattern 510 of FIG. 5B, the quadruped has its left front andright rear feet on the surface, while its right front and left rear feetare swinging. In pattern 512, the left front and right rear feet arelifted off the surface, and all four feet are swinging. In pattern 514,the right front and left rear feet touch down, while the left front andright rear feet are still swinging. In pattern 516, the right front andleft rear feet are lifted off the surface, and all four feet areswinging. In pattern 518, the left front and right rear feet touch downwhile the right front and left rear feet are swinging.

Notably, pattern 518 may be identical or similar to pattern 510. Thus,the sequence of patterns 510, 512, 514, 516, and 518 may repeat as therobot walks. Regardless, the number of feet in contact with the surfaceat any one time is either 0 or 2.

The patterns of FIGS. 4, 5A, and 5B are nominal, in the sense that theymay change based on the robot's state or environment. For instance, arobot may accelerate or delay the touchdown of a foot to accommodate arise or dip in the surface. Further, a robot may alter its gait toaccount for a disruption to its COM, or to avoid an obstacle. Thus, thegait patterns of these figures are merely for purposes of example, andnot intended to limit the implementations herein.

In addition to walking and trotting a quadruped may support other gaits,such as pacing, pronking, cantering, galloping, bounding, and so on.Further, the quadruped may support moving in various directionsaccording to its supported gaits, such as forward, backward,sidestepping left, and sidestepping right.

These additional gaits are briefly described as follows. Pacing gaitsmay involve either no feet being in contact with a surface or exactlytwo feet on the same side of the robot being in contact with thesurface. Pronking gaits may involve either no feet or all four feetbeing in contact with a surface in a repeated jumping pattern. Canteringgaits may involve either zero, exactly one, exactly two, or exactlythree feet being in contact with a surface in the following pattern: afirst rear foot touches down, then the second rear foot and a firstfront foot touches down, then the first rear foot lifts, then the secondfront foot touches down, then the second rear foot and the first frontfoot lift, then the second front foot lifts. Galloping gaits are similarto cantering gaits, except that the second rear foot and first frontfoot do not touch down simultaneously—the second rear foot touches downslightly before the first front foot. Bounding gaits may involve eitherno feet being in contact with a surface or just the two front feet orthe two rear feet being in contact with the surface. Additionally, othergaits may be defined for robots, and one or more variations of any gaitmay also be defined.

As noted above, the quadruped may also support acyclic gaits that definefootfall patterns that transition the quadruped between two gaits, suchas two cyclic gaits. Unlike cyclic gaits which may repeat for anarbitrary period of time, transitions are finite behaviors that switchbetween gaits. For two gaits that have intersecting states (e.g., aparticular robot state in terms of joint angles of the robot's legsexists in both gaits) transitioning between the gaits may involve aninstantaneous switch from one gait to the other during one of theseintersecting states. But if two gaits do not have intersecting states,the transition may continue locomotion, but change the robot'sparameters from one gait to another over a finite period of time, whilekeeping the robot in valid states throughout the transition.

Also as noted above, the quadruped may support recovery gaits thatdefine footfall patterns that cause the legged robot to recover fromdeviations from a cyclic or acyclic gait. For instance, if the quadrupeddeparts from a cyclic or acyclic gait, perhaps due to a collision withan object or attempted avoidance of such a collision, the quadruped mayadopt a recovery gait. In some cases, a recovery gait may involveswinging a leg faster or slower than normal, as long as the robotremains within a valid state. If such a leg were to move faster thannormal, it would touch down earlier. This may help place the quadrupedin a different gait than it was previously. Alternatively, if a leg isslowed or paused, the quadruped may also be able to adopt a differentgait.

Example Gait Controllers and Ordered Lists Thereof

Given that some robots may support a large number of gaits andvariations thereof, software modules to support these gaits may beorganized into discrete gait controllers. Each gait controller may mapthe robot's instantaneous state to output parameters, and may beassociated with zero or more validity checks. The state of the robot mayinclude the robot's velocity (e.g., COM velocity) and position, as wellas joint angles and joint torques for the legs of the robot, forinstance. This state may be sensed by, for example, an IMU, joint anglesensors, and/or actuators among other possibilities. The outputparameters may include prospective footstep locations, as well asdesired joint torques and/or joint angles of the robot's legs so thatthe robot can achieve the prospective footstep locations over aparticular time horizon (e.g., the next 1-5 seconds).

A validity check associated with a gait controller is a test to makesure that the robot is capable of achieving the desired gait based onits current state. As an example, if a robot is running, it might not beable to immediately transition to a standing gait without a loss ofstability (e.g., the robot will fall over). In addition to the velocityof the robot, the validity checks may include the number of feet incontact with a surface, that the robot's pitch and roll are withincertain bounds, and that the gait will not lead to the robot attemptingto place one or more of its feet in unobtainable positions. Forinstance, a validity check may verify that the gait will not cause anyof the robot's legs to collide with one another.

For each possible target gait, gait controllers may be ordered in a listsuch that the gait controller for the target gait is at the beginning(e.g., the top) of the list. Further, additional gait controllers forother gaits may be placed in the list to evolve the robot's state suchthat higher priority controllers are likely to pass their domain checks.

As an illustrative example, FIG. 6A depicts a list 600 for a target gaitof standing (which will be referred to as the “stand list”). In FIG. 6A,nine gait controllers are ordered in a list 600, starting with the standgait controller. Thus, the robot may be operating according to any ofthe defined gaits, and the robot may have decided, or been instructed,to stand. As a result, the stand gait is the target gait. For purposesof simplicity, the robot is assumed to support four cyclic gaits inaddition to standing: a slow walk at 1.5 MPH, a slow trot of 3.0 MPH, amedium walk at 3.0 MPH, and a medium trot at 5.5 MPH. The robot is alsoassumed to support four acyclic gaits: slow-walk-to-stand,slow-trot-to-stand, medium-walk-to-slow-walk, andmedium-trot-to-slow-trot.

In full generality, a robot may support any number of gaits. Forinstance, stand list 600 of FIG. 6A may include up to 10 or more walkinggaits of various velocities, as well as up to 10 or more trotting gaitsof various speeds. In some cases, the respective velocities may be closeto one another to facilitate smooth transitions between the gaits. As anexample, walking gaits at 0.5 MPH, 1.0 MPH, 2.0 MPH, 2.5 MPH, 3.0 MPH,3.5 MPH, 4.0 MPH, and 4.5 MPH may be defined. Further, acyclic gaitstransitioning between various pairs of these walking gaits may bedefined.

Not shown in FIG. 6A are gait controllers for additional gaits, such ascanter, gallop, and bound, as well as recovery gaits. However, theseomissions were made in order to simplify FIG. 6A. A stand list inaccordance with the implementations herein may include any number ofgait controllers (e.g., dozens, hundreds, etc.).

If a robot is in any of the non-standing gaits, stand list 600 of FIG.6A can be used to incrementally instruct the robot to smoothly attainthe stand gait. Starting at the beginning of stand list 600 (listposition 1), the list may be traversed in order. For each gaitcontroller, the associated validity check is performed. If the validitycheck passes, then the robot is instructed to operate according to thegait controller's output parameters. If the validity check fails, thenthe next gait controller in the list is evaluated accordingly, until avalid gait controller is found.

In FIG. 6A the validity checks are related to the instantaneous stateand velocity of the robot for purposes of simplicity. In fullgenerality, other validity checks may be included. Further, each gaitcontroller list may include a default controller in the last position ofthe list. This final gait controller instructs the robot to operateaccording to a fallback behavior if the validity checks of all othergait controllers fail. For instance, the gait controller at the end ofthe stand list may have no associated validity checks (so that theassociated gait is always valid) and the output parameters mayeffectively lock the joint positions of the robot. While this behaviormight not be ideal in some situations, it provides a behavior for therobot when all other gait controllers fail.

An algorithmic process for traversing a list of gait controllers will bepresented below in the context of FIG. 8. But for purposes of presentingstand list 600, the following high-level examples are provided. In bothexamples, the stand list 600 is traversed from the beginning until anappropriate gait controller is determined.

In one example, if a robot is operating according to the slow walk gaitof 1.5 MPH, the validity check of the stand gait controller is testedfirst, but fails. However, the validity check of the slow-walk-to-standgait controller will pass, because the robot is walking (e.g., with 2 or3 feet on the surface) at less than 2.5 MPH. The output parameters ofthe slow-walk-to-stand gait controller instruct the robot to operateaccording to the slow-walk-to-stand-gait, which transitions the robot tostanding. Stand list 600 is traversed again from the beginning and thistime the validity check for the stand gait controller passes, becausethe robot is standing (all four feet on the surface with little or novelocity). Thus, the desired stand gait is achieved

In another example, if the robot is operating according to the mediumtrot gait, stand list 600 instructs the robot to switch to themedium-trot-to-slow-trot gait. Once in the medium-trot-to-slow-trotgait, stand list 600 instructs the robot to operate according to theslow trot gait. Once in the slow trot gait, stand list 600 instructs therobot to operate according to the slow-trot-to-stand gait. Once in theslow-trot-to-stand gait, stand list 600 instructs the robot to operateaccording to the stand gait.

In general, any particular gait controller (but not the target gaitcontroller) is operable to change the state of the robot such that thechanged state at least partially satisfies the validity check of one ormore gait controllers that appear in the list before the particular gaitcontroller. In this way, each list may also be represented as ahierarchy of gait controllers.

For instance, FIG. 6B presents a hierarchical view of stand list 600. Inparticular, hierarchy 602 illustrates how a robot operating according toany gait in stand list 600 can transition to the stand gait. As just oneexample, a robot operating according to the medium walk gait maytransition to the acyclic medium-walk-to-slow-walk gait, then to theslow walk gait, then to the slow-walk-to-stand gait, and then to thestand gait. As noted above, an algorithmic process for traversing a listof gait controllers will be presented below in the context of FIG. 8.

FIG. 6B indicates that a robot can switch directly from themedium-walk-to-slow-walk gait to the slow-walk-to-stand gait withoutoperating according to the slow walk gait. Similarly, a robot can switchdirectly from the medium-trot-to-slow-trot gait to theslow-trot-to-stand gait without operating according to the slow trotgait. In some implementations, however, acyclic gaits always transitionbetween pairs of cyclic gaits, and thus transitioning directly from oneacyclic gait to another might not be supported. Instead, between acyclicgaits, the robot may spend at least a nominal amount of time (e.g., afew milliseconds or more) operating according to a cyclic gait.

As another illustrative example, FIG. 7A depicts a list 700 for a targetgait of slow walk (which will be referred to as the “slow walk list”).In FIG. 7A, nine gait controllers are ordered starting with the slowwalk gait controller. Thus, the robot may be operating according to anygait, and the robot may have decided, or been instructed, to operateaccording to the slow walk gait. Therefore, the slow walk gait is thetarget gait. The robot is assumed to support four cyclic gaits inaddition to slow walk: standing with a substantive zero velocity, a slowtrot of 3.0 MPH, a medium walk at 3.0 MPH, and a medium trot at 5.5 MPH.The robot is also assumed to support four acyclic gaits:medium-walk-to-slow-walk, stand-to-slow-walk, slow-trot-to-slow-walk,and medium-trot-to-slow-trot. Other gaits not shown in FIG. 7A may alsobe supported.

Like FIG. 6A, in FIG. 7A the validity checks are related to theinstantaneous state and velocity of the robots for purposes ofsimplicity. In full generality, other validity checks may be included.

As was the case for the stand list, any particular gait controller (butnot the target gait controller) is operable to change the state of therobot so that the changed state at least partially satisfies thevalidity check of one or more gait controllers that appear in the listbefore the particular gait controller. To that point, FIG. 7B presents ahierarchical view of slow walk list 700. In particular, hierarchy 702illustrates how a robot operating according to any cyclic gait in slowwalk list 700 can transition to the slow walk gait. As just one example,a robot operating according to the medium trot gait may transition tothe acyclic medium-trot-to-slow-trot gait, then to the slow trot gait,then to the slow-trot-to-slow-walk gait, and then to the slow walk gait.

Example Traversal of a List of Gait Controllers

FIG. 8 is a flow chart depicting an algorithmic process for traversing alist of gait controllers. This process can be applied to any list ofgait controllers, such as the stand list of FIG. 6A or the slow walklist of FIG. 7A.

At block 800, a list of gait controllers may be selected. The selectionmay be based on a particular target gait for the robot. For instance, ifthe robot's target gait is standing, the stand list of FIG. 6A may beselected. If the robot's target gait is slow walk, the slow walk list ofFIG. 7A. Other target gaits and associated lists of gait controllers maybe supported.

The target gait may, in turn, be based on one or more input commands.The robot may receive these commands from an external controller such asa joystick, or may generate the commands itself.

At block 802, a determination may be made whether to reorder theselected list. If so, at block 804 the list may be reordered. Listreordering is discussed in more detail in the following section. Blocks802 and 804 are optional, and may be omitted.

At block 806, the first gait controller in the list is considered. Thisis the target gait controller that would serve to operate the robotaccording to the target gait.

At block 808, a determination is made whether the target gait controllerpasses all associated validity checks. As noted earlier, the validitychecks may be based on the state (e.g., the instantaneous state) of therobot, and possibly other factors as well. In particular, a validitycheck may consider the current gait of the robot as well as the velocityof the robot. If these factors are within the acceptable bounds of thegait controller, then the gait controller passes the validity check. Ifnot, the gait controller fails the validity check.

Thus, if the gait controller passes the validity check, then at block812, the robot is operated according to this gait controller. If thegait controller fails the validity check, then at block 810, the nextgait controller in the list is considered. In this way, the list istraversed in order until a valid gait controller is found, and the robotis operated according to the first valid gait controller.

Since the validity checks of more than one gait controller may pass fora particular robot state and velocity, the ordering of the gaitcontrollers in the list can have a significant impact on the robot'sultimate behavior. Therefore, the list may be ordered so that operatingthe robot according to gait controllers other than the target gaitcontroller eventually (directly or indirectly) result in the robot stateand velocity passing the validity check of the target gait controller.Thus, gait controllers lower in the list may be operable to change thestate of the robot such that the changed state at least partiallysatisfies the validity check of one or more gait controllers that appearhigher in the list.

The operations of FIG. 8 may be performed continuously, periodically, orfrom time to time. In some implementations, the operations of FIG. 8 maycontinuously repeat in a loop tens or hundreds of times per second. Thismay result in the robot switching gait controllers mid-stride one ormore times. Alternatively, the robot may maintain the same gait for oneor more full cycles of a gait. Other possibilities exist.

The following example illustrates the operations of FIG. 8 applied tothe stand list of FIG. 6A. In this example, the robot is assumed to be aquadruped moving according to a 5.5 MPH trot. The robot may receive acommand to transition to a standing position. As a result, the robot mayselect the stand list of FIG. 6A because the stand gait is the targetgait of this list.

Starting at list position 1, the robot considers the associated gaitcontroller. This gait controller, which is for the target stand gait,requires that all four of the robot's feet are on a surface and that therobot's velocity is less than or equal to a nominal velocity of 0.1 MPH.This non-zero nominal velocity allows the robot's COM to sway to a smallextent as long as the robot maintains a four-footed contact with thesurface. In any case, the validity check fails because the robot ismoving with a velocity that is greater than 0.1 MPH.

The robot then considers the slow-walk-to-stand gait controller at listposition 2. This gait controller requires that the robot is walking andthat the robot's velocity is less than or equal to 2.5 MPH. The validitycheck for the slow-walk-to-stand gait controller fails because therobot's velocity is too high. This validity check may also fail becauseit requires that either exactly two or exactly three of the robot's feetare in contact with the surface (while some phases of the trot gait mayinvolve exactly two feet in contact with the surface, other phases donot).

The robot then considers the slow-trot-to-stand gait controller at listposition 3. This gait controller requires that the robot is trotting(e.g., with either one diagonal pair of feet on the surface while theother diagonal pair of feet are swinging, all four feet on the surface,or all four feet off of the surface) at a velocity less than or equal to4.0 MPH. While the robot is trotting, its velocity is once again toohigh to pass this validity check.

The robot then considers the slow walk gait controller at list position4, the validity check of which fails because the robot's velocity is toolow, and may additionally fail because the robot is trotting. Thevalidity check of the slow trot gait controller at list position 5 alsofails because the robot's velocity is too high, as does the validitycheck of the medium-walk-to-slow-walk gait controller at list position6.

However, the validity check of the medium-trot-to-slow-trot gaitcontroller at list position 7 passes because the robot is trotting witha velocity that is greater than 4.0 MPH and less than or equal to 7.0MPH. Therefore, the robot applies the output parameters of themedium-trot-to-slow-trot gait controller. For instance, these outputparameters may define a series of leg actuation states and/or leg jointangles that transition the robot from its current trotting speed to aslow trot of 3.0 MPH.

Once the robot achieves the slow trot of 3.0 MPH, the robot traversesthe list once again from the beginning. Thus, the robot considers thestand gait controller at list position 1. The validity check of thisgait controller fails because the robot's velocity is too high. Next,the robot considers the slow-walk-to-stand gait controller at listposition 2. The associated validity check fails for this gait controlleras well, once again because the robot's velocity is too high.

The validity check of the slow-trot-to-stand gait controller passes,however, and the robot applies the associated output parameters. Forinstance, these output parameters may define a series of leg actuationstates and/or leg joint angles that transition the robot from itscurrent trotting speed to a standing position with zero or near-zerovelocity.

After doing so, the robot continues to iterate traversals of the list,each traversal starting at the beginning of the list. As long as therobot remains standing, the validity check for the stand gait controllerwill pass, and the robot will remain in the standing gait (which is alsothe target gait). If the robot experiences a disturbance, for instanceif its footing slips or it is pushed off balance, the robot may apply adifferent gait controller to regain its standing gait. For example, arecovery gait controller (not shown in FIG. 6A) may be used.

On the other hand, if the robot determines that it should move accordingto a particular gait (e.g., a walk or trot), the robot may select adifferent list (such as the list of FIG. 7A), and proceed according toone or more gait controllers in the selected list.

Additional Features

In addition to the features and operations described above, theimplementations herein may include the additional features and/oroperations described in this section. Nonetheless, these features areoptional, and may or may not be included.

List Reordering

As noted in the previous section, a list of gait controllers may bereordered. For instance, a first intermediate gait controller and asecond intermediate gait controller may be identified. Neither of thesegait controllers are the target gait controller, but each can be used bythe robot to achieve the target gait. Possibly based on an instantaneousstate of the robot, the first intermediate gait controller may beselected as more favorable than the second intermediate gait controllerfor achieving the target gait. The list may be reordered such that thefirst intermediate gait controller is before the second intermediategait controller in the list.

As an example, suppose that a standing quadruped is instructed to beginwalking forward. In order to do so, the quadruped selects a foot to movefirst. In principle, any of the quadruped's four feet could be selectedand would work equally well. Thus, the quadruped may be configured toalways step first with its left front foot. However, if the robot'sinstantaneous stance is such that the left front foot is fully extendedforward, the robot might not be able to step further forward with thatfoot. Therefore, in this situation, the robot should step first with oneof the other three feet.

In order to facilitate making such determinations, a walk list mayinclude four stand-to-walk controllers, each moving a different footfirst. Based on its instantaneous leg actuation states and/or leg jointangles, the robot may assign a cost to each. Particularly, this cost maybe higher for the fully extended left front foot than the other threefeet. These four gait controllers may be sorted in increasing order ofcost in the list so that a gait controller that steps first with a footother than the front left is preferentially chosen.

Alternatively, the robot may also select a foot to step with throughvalidity checks rather than list reordering. Particularly, the statespace of the robot may be segmented such that exactly one of the fourstep-with-one-foot-first gait controllers is valid at a given state.Doing so limits the domain of gait controllers beyond what is requiredfor the gait controller to be feasible. For example, consider step leftand step right gait controllers, which are valid (e.g., the robot willnot fall) for lateral velocity ranges of (−1,2), and (−2,1),respectively. Rather than setting validity checks that match thesevelocity ranges, the validity checks might be set to the lateralvelocity ranges (0,2), and (−2,0) respectively. Even though the stepleft gait controller can operate in the range of (−1,0), this range isruled out because operating the step right gait controller will resultin smoother gait behavior.

In some embodiments, a list of gait controllers may be reordered basedon the previously-running gait controller. For example, if the robot waspreviously running a trot gait controller and is currently operatingaccording to the stand list, the trot-to-stand gait controller may beplaced above the walk-to-stand gait controller so that the robotcorrectly selects the trot-to-stand gait controller even if both gaitcontrollers are valid.

Further Validity Checks

In addition to validity checks involving the gait of the robot and thevelocity of the robot, the pitch and/or roll of the robot may beconsidered as well. When performing certain tasks, such as traveling onuneven terrain, the robot's pitch and roll may deviate from zero-degreevalues. Such deviations may be detected by the robot's IMU, or someother sensor.

For instance, the pitch of the robot may be 10 or 20 degrees whenclimbing a hill, or the roll of the robot may be −10 or −20 degrees whentraveling sideways on a hill. In order to maintain stability of therobot, some validity checks may include limits on the pitch and/or rollof the robot. These limits might include acceptable pitch and/or rollranges of −10 degrees to 10 degrees, −20 degrees to 20 degrees, −40degrees to 40 degrees, and so on. If the robot's pitch or roll fallsoutside of an acceptable range, a recovery gait controller may beselected that operates the robot to stabilize its pitch and/or roll.

Additional validity checks may avoid situations where the robot attemptsto step out further than its foot can reach. For instance, consider thesequence of footfall patterns in FIG. 9. Pattern 900 indicates that therobot is standing, with all four feet on a surface. Possibly due to adisturbance, such as the robot being pushed to its left, the robotdetermines a target placement for its left front foot represented by thedotted circle. For instance, the robot may have calculated that placingits left front foot in this location would stabilize its balance.However, this location is beyond the distance that the robot can step.The validity check of any gait controller may fail if this invalidstep-out is attempted.

But, as shown in FIG. 9, the robot may instead operate according to oneor more recovery gait controllers that stabilize the robot without sucha step-out. Particularly, as shown in patterns 902, 904, 906, 908, 910,and 912, the recovery gait controller(s) move the robots feet laterallyin smaller steps. First, the robot's left front foot moves toward thetarget placement, and then it is followed by the right rear foot, rightfront foot, left rear foot, right rear foot, and the left front foot. Inpattern 912, the left front foot is at the target placement, and therobot is stabilized.

FIG. 9 is just one possible implementation of avoid an invalid step-out.Other footfall patterns may be used to accomplish this goal.

Example Operations

FIG. 10 is a flow chart illustrating an example implementation. Theimplementation illustrated by FIG. 10 may be carried out by a computingdevice, processor(s) 102 and/or controller(s) 108. However, theimplementation can be carried out by other types of devices or devicesubsystems, including a device that is part of or not part of a leggedrobot being controlled. Further, the implementation may be combined withany other aspect or feature disclosed in this specification or theaccompanying drawings.

Block 1000 of FIG. 10 may involve determining that a legged robot is tooperate according to a target gait, wherein the legged robot includesleg members and leg joints.

Block 1002 may involve, possibly based on the target gait and state ofthe legged robot, obtaining an ordered list of gait controllers. Thegait controllers in the ordered list may define respective gaits of thelegged robot, and include respective validity checks and outputparameters for the respective gaits. The ordered list may begin with atarget gait controller that defines the target gait. Any given gaitcontroller in the ordered list (that is not the target gait controller)may be operable to change the state of the legged robot such that thechanged state at least partially satisfies the validity check of one ormore gait controllers that appear in the ordered list before theparticular gait controller.

Block 1004 may involve traversing the ordered list in order from thetarget gait controller until a validity check associated with aparticular gait controller passes. The particular gait controller may bethe target gait controller or another gait controller in the orderedlist. The validity check associated with the particular gait controllermay determine whether the particular gait controller is permitted tooperate based on the state of the robot and/or a sensed environment ofthe robot, for instance.

Block 1006 may involve instructing the legged robot to actuate the legmembers or leg joints according to output parameters of the particulargait controller.

In some implementations, after instructing the legged robot to actuatethe leg members or leg joints according to output parameters of theparticular gait controller, the ordered list may be traversed again inorder from the target gait controller until a second validity checkassociated with a second particular gait controller passes. The leggedrobot may be instructed to actuate the leg members or leg jointsaccording to output parameters of the second particular gait controller.

In some implementations, after instructing the legged robot to actuatethe leg members or leg joints according to output parameters of theparticular gait controller, it may be determined that the legged robotis to operate according to a second target gait. Possibly based on thesecond target gait and a second state of the legged robot, a secondordered list of the gait controllers may be obtained. The second orderedlist may begin with a second target gait controller that defines thesecond target gait. The second ordered list may be traversed in orderfrom the second target gait controller until a validity check associatedwith a second particular gait controller passes. The legged robot may beinstructed to actuate the leg members or leg joints according to outputparameters of the second particular gait controller.

At least some of the gait controllers may be either (i) cyclic gaitcontrollers that define respective touchdown timings and positions forfeet of the legged robot that cause the legged robot to operateaccording to the respective gaits, (ii) acyclic gait controllers thatdefine touchdown timings and positions for the feet that cause thelegged robot to transition from one gait to another, or (iii) recoverygait controllers that define touchdown timings and positions for thefeet that cause the legged robot to recover from deviations from acyclic or acyclic gait. In some implementations, the ordered list ofgait controllers may include one or more of each of the cyclic gaitcontrollers, acyclic gait controllers, and recovery gait controllers.

The legged robot may have four legs. The gait controllers may include awalk gait controller with an associated validity check that requiresexactly two or exactly three legs of the legged robot to be on asurface. In some implementations, the gait controllers may include atrot gait controller with an associated validity check that requiresexactly one diagonal pair of legs, all four legs, or no legs of thelegged robot to be on a surface. The associated validity checks may alsorequire that a swing foot will not land beyond a threshold distance froma COM of the robot. The gait controllers may include at least two trotgait controllers with associated validity checks that require exactlyone diagonal pair of legs, all four legs, or no legs of the legged robotto be on a surface. Each of the two trot gait controllers may beassociated with different trot velocities.

In some implementations, the gait controllers may include a stand gaitcontroller with an associated validity check that requires all legs ofthe legged robot to be on a surface, and a velocity of the legged robotto be below a threshold value.

In some situations, possibly after block 1002 and before block 1004, afirst intermediate gait controller and a second intermediate gaitcontroller may be identified, each of which can be used for the leggedrobot to achieve the target gait. Possibly based on an instantaneousstate of the legged robot, the first intermediate gait controller may beselected as more favorable than the second intermediate gait controllerfor achieving the target gait. The ordered list may be reordered suchthat the first intermediate gait controller is before the secondintermediate gait controller in the ordered list.

Conclusion

The present disclosure is not to be limited in terms of the particularimplementations described in this application, which are intended asillustrations of various aspects. Many modifications and variations canbe made without departing from its scope, as will be apparent to thoseskilled in the art. Functionally equivalent methods and apparatuseswithin the scope of the disclosure, in addition to those enumeratedherein, will be apparent to those skilled in the art from the foregoingdescriptions. Such modifications and variations are intended to fallwithin the scope of the appended claims.

The above detailed description describes various features and functionsof the disclosed systems, devices, and methods with reference to theaccompanying figures. The example implementations described herein andin the figures are not meant to be limiting. Other implementations canbe utilized, and other changes can be made, without departing from thescope of the subject matter presented herein. It will be readilyunderstood that the aspects of the present disclosure, as generallydescribed herein, and illustrated in the figures, can be arranged,substituted, combined, separated, and designed in a wide variety ofdifferent configurations, all of which are explicitly contemplatedherein.

With respect to any or all of the message flow diagrams, scenarios, andflow charts in the figures and as discussed herein, each step, block,and/or communication can represent a processing of information and/or atransmission of information in accordance with example implementations.Alternative implementations are included within the scope of theseexample implementations. In these alternative implementations, forexample, operations described as steps, blocks, transmissions,communications, requests, responses, and/or messages can be executed outof order from that shown or discussed, including substantiallyconcurrent or in reverse order, depending on the functionality involved.Further, more or fewer blocks and/or functions can be used with any ofthe ladder diagrams, scenarios, and flow charts discussed herein, andthese ladder diagrams, scenarios, and flow charts can be combined withone another, in part or in whole.

A step or block that represents a processing of information cancorrespond to circuitry that can be configured to perform the specificlogical functions of a herein-described method or technique.Alternatively or additionally, a step or block that represents aprocessing of information can correspond to a module, a segment, or aportion of program code (including related data). The program code caninclude one or more instructions executable by a processor forimplementing specific logical functions or actions in the method ortechnique. The program code and/or related data can be stored on anytype of computer readable medium such as a storage device including adisk, hard drive, or other storage medium.

The computer readable medium can also include non-transitory computerreadable media such as computer-readable media that store data for shortperiods of time like register memory, processor cache, and random accessmemory (RAM). The computer readable media can also includenon-transitory computer readable media that store program code and/ordata for longer periods of time. Thus, the computer readable media mayinclude secondary or persistent long term storage, like read only memory(ROM), optical or magnetic disks, compact-disc read only memory(CD-ROM), for example. The computer readable media can also be any othervolatile or non-volatile storage systems. A computer readable medium canbe considered a computer readable storage medium, for example, or atangible storage device.

Moreover, a step or block that represents one or more informationtransmissions can correspond to information transmissions betweensoftware and/or hardware modules in the same physical device. However,other information transmissions can be between software modules and/orhardware modules in different physical devices.

The particular arrangements shown in the figures should not be viewed aslimiting. It should be understood that other implementations can includemore or less of each element shown in a given figure. Further, some ofthe illustrated elements can be combined or omitted. Yet further, anexample implementation can include elements that are not illustrated inthe figures.

Additionally, any enumeration of elements, blocks, or steps in thisspecification or the claims is for purposes of clarity. Thus, suchenumeration should not be interpreted to require or imply that theseelements, blocks, or steps adhere to a particular arrangement or arecarried out in a particular order.

While various aspects and implementations have been disclosed herein,other aspects and implementations will be apparent to those skilled inthe art. The various aspects and implementations disclosed herein arefor purposes of illustration and are not intended to be limiting, withthe true scope being indicated by the following claims.

What is claimed is:
 1. A method comprising: receiving, at a processor ofa legged robot, sensor information from one or more sensors of thelegged robot, the legged robot including jointed legs; determining, bythe processor, an instantaneous state of the legged robot based on thesensor information; determining, by the processor, a target gait foroperating the legged robot on a ground surface; obtaining, by theprocessor, an initial gait controller based on the target gait foroperating the legged robot, the initial gait controller comprising: avalidity check associated with the target gait; and one or more outputparameters associated with the target gait, the one or more outputparameters comprising target step locations to achieve the target gaitand at least one of target joint torques or target joint angles for thejointed legs to achieve the target step locations; determining, by theprocessor, whether the instantaneous state of the legged robot satisfiesthe validity check associated with the target gait for the initial gaitcontroller; and when the instantaneous state of the legged robotsatisfies the validity check associated with the target gait for theinitial gait controller, instructing, by the processor, the jointed legsto actuate based on the one or more output parameters associated withthe initial gait controller, the actuation of the jointed legs causingthe legged robot to achieve the target gait.
 2. The method of claim 1,further comprising, when the instantaneous state of the legged robotdoes not satisfy the validity check associated with the target gait forthe initial gait controller: obtaining, by the processor, a second gaitcontroller based on the target gait for operating the legged robot, thesecond gait controller associated with an intermediary gait foroperating the legged robot and comprising: a respective validity checkassociated with the intermediary gait; and one or more respective outputparameters associated with the intermediary gait, the one or morerespective output parameters comprising target step locations to achievethe intermediary gait and at least one of target joint torques or targetjoint angles for the joints legs to achieve the target step locations;determining, by the processor, whether the instantaneous state of thelegged robot satisfies the respective validity check associated with theintermediary gait for the second gait controller; and when theinstantaneous state of the robot satisfies the respective validity checkassociated with the intermediary gait for the second gait controller,instructing, by the processor, the jointed legs to actuate based on theone or more respective output parameters associated with theintermediary gait for the second gait controller, the actuation of thejointed legs causing the legged robot to achieve the intermediary gait.3. The method of claim 2, further comprising, when the instantaneousstate of the robot does not satisfy the respective validity checkassociated with the intermediary gait for the second gait controller:obtaining, by the processor, a third gait controller from an orderedlist of gait controllers, the third gait controller having an associatedvalidity check satisfied by the instantaneous state of the legged robot;and instructing, by the processor, the jointed legs to actuate based onthe one or more output parameters associated with a respective gait forthe third gait controller, the actuation of the jointed legs causing thelegged robot to achieve the respective gait.
 4. The method of claim 2,further comprising, obtaining, by the processor, a plurality of gaitcontrollers for operating the legged robot; and when the instantaneousstate of the legged robot does not satisfy the respective validity checkassociated with the intermediary gait for the second gait controller:determining, by the processor, whether the instantaneous state of thelegged robot satisfies a corresponding validity check associated with acorresponding gait for any of the obtained plurality of gaitcontrollers; and when the instantaneous state of the legged robot doesnot satisfy the corresponding validity check associated with thecorresponding gait for any of the obtained gait controllers: obtaining,by the processor, a recovery gait controller associated with arespective recovery gait for operating the legged robot and comprisingone or more recovery output parameters associated with the respectiverecovery gait; and instructing, by the processor, the jointed legs toactuate based on one or more recovery output parameters associated withthe recovery gait for the recovery gait controller.
 5. The method ofclaim 2, further comprising, after instructing the jointed legs toactuate based on the one or more respective output parameters associatedwith the intermediary gait: determining, by the processor, whether theinstantaneous state of the legged robot satisfies the validity checkassociated with the target gait for the initial gait controller; andwhen the instantaneous state of the legged robot satisfies the validitycheck associated with the target gait for the initial gait controller,instructing, by the processor, the jointed legs to actuate based on theone or more output parameters associated with the target gait, theactuation of the jointed legs causing the legged robot to achieve thetarget gait.
 6. The method of claim 1, wherein determining the targetgait for operating the legged robot comprises receiving an input commandfrom an external controller in communication with the processor for thelegged robot, the input command comprising an instruction for the leggedrobot to perform the target gait.
 7. The method of claim 1, whereindetermining the target gait for operating the legged robot comprisesreceiving an input command from an external controller in communicationwith the processor of the legged robot, the input command comprising aninstruction to move the legged robot to a target geographical location.8. The method of claim 1, wherein the initial gait controller comprisesone of a plurality of gait controllers associated with an ordered listof gait controllers.
 9. The method of claim 8, wherein at least one ofthe gait controllers of the ordered list of gait controllers comprises:a cyclic gait controller defining respective touchdown timings andpositions for feet of the legged robot that cause the legged robot tooperate according to the respective gait; an acyclic gait controllerdefining touchdown timings and positions for the feet that cause thelegged robot to transition from one gait to another gait; or a recoverygait controller defining touchdown timings and positions for the feetthat cause the legged robot to recover from deviations from a cyclicgait or an acyclic gait.
 10. The method of claim 1, wherein the targetgait for the initial gait controller comprises one of a standing gait, aslow-walk-to-stand gait, a slow-trot-to-stand gait, a slow walk gait, aslow trot gait, a medium-walk-to-slow-walk gait, a medium-trot-to-slow-trot gait, a medium walk gait, or a medium trot gait.
 11. Themethod of claim 1, wherein the instantaneous state comprises kinematicsof the legged robot.
 12. The method of claim 11, wherein the kinematicsof the legged robot further comprises at least one of a position of thelegged robot, an angle associated with each leg joint of a jointed leg,or a torque associated with each leg joint of the jointed leg.
 13. Alegged robot comprising: jointed legs; one or more sensors; a processorin communication with the one or more sensors; and a non-transitorycomputer-readable medium in communication with the processor and storinginstructions, that when executed by the processor, cause the processorto perform operations comprising: receiving sensor information from theone or more sensors of the legged robot; determining an instantaneousstate of the legged robot based on the sensor information; determining atarget gait for operating the legged robot on a ground surface;obtaining an initial gait controller based on the target gait foroperating the legged robot, the initial gait controller comprising: avalidity check associated with the target gait; and one or more outputparameters associated with the target gait, the one or more outputparameters comprising target step locations to achieve the target gaitand at least one of target joint torques or target joint angles for thejointed legs to achieve the target step locations; determining whetherthe instantaneous state of the legged robot satisfies the validity checkassociated with the target gait for the initial gait controller; andwhen the instantaneous state of the legged robot satisfies the validitycheck associated with the target gait for the initial gait controller,instructing the jointed legs to actuate based on the one or more outputparameters associated with the initial gait controller, the actuation ofthe jointed legs causing the legged robot to achieve the target gait.14. The legged robot of claim 13, wherein the operations furthercomprise, when the instantaneous state of the legged robot does notsatisfy the validity check associated with the target gait for theinitial gait controller: obtaining a second gait controller based on thetarget gait for operating the legged robot, the second gait controllerassociated with an intermediary gait for operating the legged robot andcomprising: a respective validity check associated with the intermediarygait; and one or more respective output parameters associated with theintermediary gait, the one or more respective output parameterscomprising target step locations to achieve the intermediary gait and atleast one of target joint torques or target joint angles for the jointslegs to achieve the target step locations; determining whether theinstantaneous state of the legged robot satisfies the respectivevalidity check associated with the intermediary gait for the second gaitcontroller; and when the instantaneous state of the robot satisfies therespective validity check associated with the intermediary gait for thesecond gait controller, instructing the jointed legs to actuate based onthe one or more respective output parameters associated with theintermediary gait for the second gait controller, the actuation of thejointed legs causing the legged robot to achieve the intermediary gait.15. The legged robot of claim 14, wherein the operations furthercomprise, when the instantaneous state of the robot does not satisfy therespective validity check associated with the intermediary gait for thesecond gait controller: obtaining a third gait controller from anordered list of gait controllers, the third gait controller having anassociated validity check satisfied by the instantaneous state of thelegged robot; and instructing the jointed legs to actuate based on theone or more output parameters associated with a respective gait for thethird gait controller, the actuation of the jointed legs causing thelegged robot to achieve the respective gait.
 16. The legged robot ofclaim 14, wherein the operations further comprise, obtaining a pluralityof gait controllers for operating the legged robot; and when theinstantaneous state of the legged robot does not satisfy the respectivevalidity check associated with the intermediary gait for the second gaitcontroller: determining whether the instantaneous state of the leggedrobot satisfies a corresponding validity check associated with acorresponding gait for any of the obtained plurality of gaitcontrollers; and when the instantaneous state of the legged robot doesnot satisfy the corresponding validity check associated with thecorresponding gait for any of the obtained gait controllers: obtaining arecovery gait controller associated with a respective recovery gait foroperating the legged robot and comprising one or more recovery outputparameters associated with the respective recovery gait; and instructingthe jointed legs to actuate based on one or more recovery outputparameters associated with the recovery gait for the recovery gaitcontroller.
 17. The legged robot of claim 14, wherein the operationsfurther comprise, after instructing the jointed legs to actuate based onthe one or more respective output parameters associated with theintermediary gait: determining whether the instantaneous state of thelegged robot satisfies the validity check associated with the targetgait for the initial gait controller; and when the instantaneous stateof the legged robot satisfies the validity check associated with thetarget gait for the initial gait controller, instructing the jointedlegs to actuate based on the one or more output parameters associatedwith the target gait, the actuation of the jointed legs causing thelegged robot to achieve the target gait.
 18. The legged robot of claim13, wherein determining the target gait for operating the legged robotcomprises receiving an input command from an external controller incommunication with the processor for the legged robot, the input commandcomprising an instruction for the legged robot to perform the targetgait.
 19. The legged robot of claim 13, wherein determining the targetgait for operating the legged robot comprises receiving an input commandfrom an external controller in communication with the processor of thelegged robot, the input command comprising an instruction to move thelegged robot to a target geographical location.
 20. The legged robot ofclaim 13, wherein the initial gait controller comprises one of aplurality of gait controllers associated with an ordered list of gaitcontrollers.
 21. The legged robot of claim 20, wherein at least one ofthe gait controllers of the ordered list of gait controllers comprises:a cyclic gait controller defining respective touchdown timings andpositions for feet of the legged robot that cause the legged robot tooperate according to the respective gait; an acyclic gait controllerdefining touchdown timings and positions for the feet that cause thelegged robot to transition from one gait to another gait; or a recoverygait controller defining touchdown timings and positions for the feetthat cause the legged robot to recover from deviations from a cyclicgait or an acyclic gait.
 22. The legged robot of claim 13, wherein thetarget gait for the initial gait controller comprises one of a standinggait, a slow-walk-to-stand gait, a slow-trot-to-stand gait, a slow walkgait, a slow trot gait, a medium-walk-to-slow-walk gait, amedium-trot-to-slow-trot gait, a medium walk gait, or a medium trotgait.
 23. The legged robot of claim 13, wherein the instantaneous statecomprises kinematics of the legged robot.
 24. The legged robot of claim23, wherein the kinematics of the legged robot further comprises atleast one of a position of the legged robot, an angle associated witheach leg joint of a jointed leg, or a torque associated with each legjoint of the jointed leg.